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ACCESS TO INTERNET DATA THROUGH A TELEVISION SYSTEM 

60/040,763, filed March 14, 19* /. we su J 
incorporated herein. 

BACKGROUND s of two-way 

whichhasadistinct^urnencad^ A ^ t0 ^ desire d Internet address 

one of the networked computer ^^^^ set of data be sent to the 

terminal. T*e user termmals are be limited t0 the identity of the 

system infceuser'scor—^ 

p^icularnetworkedcomputers ^^^^^^ The additional 
,he networked computer system to send a part a ^ 

dependingupon*^^^^ 

The World Wide Web ( ww wmtem ; ^ ^ PhUips .Magnavox and 
30 use.Apparatussoldundermet^ 

Sony, allow television viewers to access me w t fey 

television program being viewed. 
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SUMMARY OF THE INVENTION 

According to one embodiment of the invention, an interactive entertainment network 
system is provided which includes a number of user interface units in individual homes, each 
having a tuner, a display device and a modem or other data interface device for 
communicating with a data service provider. A television signal provider supplies a plurality 
of television signals to the tuner of each user interface unit, wherein at least one of the 
television signals has embedded data including a particular data address site. Information 
representing the particular data address site is displayed simultaneously with the television 
program on the display device, e.g., either as a graphical icon or text. A data service provider 
in two-way connection with the modem of each user interface site retrieves and transmits 
data corresponding to a data address site requested by an individual user interface unit for 
display on the display device of that user. 

According to another embodiment of the invention, a display controller for coupling to 
a display device and to a data retrieval terminal in two-way communication with a data 
service provider is provided. The display controller includes a tuner for receiving a 
television signal containing a television program and at least one embedded data unit 
including a data address site, means for extracting the at least one embedded data unit from 
the television signal, a memory for storing the at least one data unit, and a video display 
generator. The display controller also includes a microcontroller coupled to the tuner and the 
extracting means and the memory for storing the at least one data unit in the memory, 
controlling the video display generator to display the data site address on the display device 
simultaneously with the television program, selectively retrieving the data site address from 
£e aeaMHJ m response id a user reqiKS, cooooliiig the data retrieval terminal to request 
data corresponding to the user selected data address she from the data service prtnSder, and 
controlling the video display generator to format and display the requested data received from 
the data service provider on the display device. 

According to yet another embodiment of the invention, a method is provided for 
enhancing viewing of a television program with interactive information retrieval. The 
method includes the steps of, at a television signal provider, embedding at least one data unit 
comprising a data site address into a television signal containing a television program. Then, 
at a user site, receiving the television signal, extracting the data unit from the television 
signal, displaying information representative of the data address site simultaneously with the 
television program on a display device, and then storing the data address site in a memory. 
Once the user selects the information representative of the data address site, a connection is 
established with a data service provider having access to data corresponding to the selected 
data address site, the data corresponding to the data address site is requested and transmitted 
from the data service provider to the user site. The retrieved data is then formatted and 
displayed on the display device at the user site. Preferably, several data address sites are 
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steed in the memory simultaneously and. at the user's request, displayed in a menu from 
which the user can select a particular address site. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The attached figures demonstrate alternative embodiments of a system des.gned m 
accordance with the present invention in which 

FIO. 1 is a block diagram schematic demonstrating a system according to one 
embodiment of the present invention; ,u„.„H«t« 

pjG 2 is a display including an exemplary graphical icon identifying that a data 
address site is available with the displayed television program; 

nG.3isadisplayofanmtemetmodeaccordingtoanotherembod.mentwh.ch 

includes several data address sites; 

FIO 4 is a display of the Internet mode according to the embodiment of FIG. 3 
displaying data corresponding to a selected data address site; 

FIO. 5 is a plan view of a remote controller for use with an embodiment of the 

inVenU HG 6 is a display of the Internet mode according to yet another embodiment 
embodiment of the present invention. , ( 

DETA^ro DESCRD^nO^^ embo( j imen t 0 f the invention, television programs are linked 

television vbwer embodimen , of the invention. In FIG. 1 , the reference 

numeT^fer^ 

Tune 6 1995 the disclosure of which is incorporated fully herein by reference. 

W, reference to FIG. 1, a source of television signals 10 such as a terrestnal 
^l^c^*.^*-"- The output of tuner 11 is a 
modulated intermediate frequency signal containing video and ' ° " 

Tuner 11 is connected by an intermediate frequency amplifier (IF AMP) 12 ^ p.cwi 
III <S£3£ DOT) 13 and a sound detector (SOUND 0*0 14. w ich produce^ 
bli band video and audio signals, respective*. The audio signal , coupled by a sound 
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wishes to imem proce s S or 30, where the Internet site 

30 is a bit map of what is disp.ayed on the screen of tension receiver 20. Video 
30 ,s tat m p Qf pip 19 preferably> yiewer mput 

displayed on the screen by keym «*o P ^ yCR 

0 ^croprocessoribyauansmissi on lirJc 34 such as a telephone network or a teev^n 
Tie' An interface devic such M .«^«c^n^3S.-d^» te te 

d ^ (not — rc-trz wen.own 

iswatclTngt erne, data is embedded in the vertical blan^ng interval (VBI) of the television 
s g I cany ng the program. According one embodiment, the Internet data includes the 
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c W ryin B thcprogn«nbcU 16 ^, S ^^ ^^or 24. Microprocessor 24 

to television program is ^P l8 ^ M1 ^" ^ ^ iss «,redinrn e mory 36. Icon95 can 
Tatlternetdauac^^ 

inFIQ .5 >W hich introduces antatrue-^ 
^Uprogranunedtoc^out^so^ 

vieW er can toggle back and ^^^„ aM * 1 ^****>~*^ 
■ m one embodiment, the Internet a ^ h6 site information may be 

window on the television screen such ^ h6 ^ nvereelyi the ^vision signal may be 
view^simultaneouslyw^^ 

^inaPIPwindowon^ 
Lbodiment.themtemets.temfon^auon^ 

te ,evisionmod^ 

Renames displayed in area 46 by moving a curs particular program ( 1 . 

iJlARRlED WITH CHILDREN' ^^^^^b^he system provider ("3. SPORTS"; 4. 
F OX(SCHEDUlXn.gcneral«^ 

SHOPPING")' or directed to the '\^j^J^j 1B viewer presses INFO button 54 on 
After an Internet site name tss^^ 
3S controlled. ^ a result, the mtemet s.te addr^J ^ugh the telephone or 

acquisition, it will instruct the modem 
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After establishing a connection to the ISP, the microprocessor 24 initiates a data request from 
the Internet site address which was received along with the graphical icon transmitted in the 
data unit. The microprocessor 24 thereafter receives the requested Internet data, and stores it 
in RAM. The requested Internet data may include graphics, text, or a combination of both. 
After receiving the Internet data, the microprocessor may or may not terminate the modem 
connection to the ISP, depending upon the design of the embodiment, or the configuration 
options set by the viewer. (If desired, this function of microprocessor 24 could be carried out 
by commercial equipment sold under the trademark "WebTV," provided by 
Philips/Magnavox and Sony.) 

The information at the addressed Internet site is downloaded from ISP 33 over 
transmission link 34 to microprocessor 24 and then displayed on the screen simultaneously 
with the television program to which the information relates, as illustrated in FIG. 4, after 
being composed by video processor 30. As illustrated in FIG. 4, the name of the Internet site 
can be displayed above the text of the information from the Internet site. If the television 
program is a television series such as "Married With Children," the displayed information 
could be an Internet "page" trivia about the show (FIG. 4), merchandising and home 
shopping information, or a link to a fan e-mail site. The viewer then navigates about the 
Internet site in the manner dictated by the viewer's software to find the desired informatioa 
Only an initial portion of the Internet data is displayed, as the amount of Internet data 
received will likely exceed the amount conveniently displayable at one time. The viewer 
may "scroll" through the remainder of the Internet data or "page," at his or her discretion, in 
oac embodiment by utilizing arrow keys on a remote control. The user interface of the page 
a conveadosai raanner. e.g.. in the -manner of a typical PC- 
A with WebTV, provided by Phflips- 
Magnavox, or Sony. 

If desired, the display of FIG. 3 could be eliminated. In other words, only one Internet 
site address would be embedded in the VBI of the television signal and the viewer would not 
make an Internet site selection. In this case, inclusion of the Internet site name is optional, 
because the viewer does not have a choice of Internet sites. When the viewer wishes to 
access Internet information about a program marked with an icon, the viewer presses burton 
56, the VBI Internet site address is sent through the telephone or cable interface to ISP 33, 
and the display of FIG. 4 appears directly on the screen with the VBI Internet site name. 
Preferably, the television program is displayed full screen until the data retrieved from the 
ISP 33 is available for display, i.e., after establishing a connection with the ISP 33, requesting 
the data, etc. Preferably, the graphical icon 95 ceases to be displayed once the viewer selects 
the Internet data. 

In a typical Internet "web page," there are "links" to other Internet addresses, which 
provide alternative or complementary data to that found in the originally displayed web page. 
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In a preferred embodiment of the invention, a user may select one of these links with a 
remote control, utilizing arrow keys 58, and/or on-screen cursor 48. For example, in FIG. 4, 
the answer to the trivia question is contained in a linked web page the viewer can select to 
confirm his or her response. These links are commonly referred to as "hypertext" links. If a 
link is selected, the microprocessor transmits the desired address to the ISP, and thereafter 
receives and displays the newly-received Internet data in the manner described above. Thus, 
if it is desirable to allow the viewer to link to additional Internet site addresses, the 
microprocessor should maintain the modem connection to the ISP 33 until directed by the 
user to terminate the connection. In this manner, the repeated request and receipt of 

ss will not necessitate delays associated with initiating a connection to the ISP 



In orderto accommodate the simultaneous viewing of both the Internet site Internet 
information and the television signal, particularized display formats may be used In a 
further embodiment, the information for the Internet site is formatted to fit around the PIP 
window in which the television program is displayed, as shown in FIG. 6. Typical Internet 
data received over the World Wide Web is transmitted in HyperText Markup Language 
("HTML") A typical HTML file includes text, graphics, and instructions for formatting the 
text and graphics on a screen, along with other embedded commands. A computer or other 
terminal displaying an HTML file will format the file for display on the screen, based in part 
upon the embedded instructions for formatting the text and graphics, and based in part upon 
the requirements for aesthetic and efficient display of the information on the particular 
viewing device. . ., 

When displaying two video signals simultaneously using the PIP format, typically one 
vid.60 signal copies the majority of the viewing screen, while tbe.second. video signal is 
dlsiBay'edln or'near to one comer of the television screen and typically occupies one quarter 
" of the screen or less. Withthis type of display format, the second video signal obscures a not 
insubstantial portion of the first video signal. This can result in an inefficient and undesirable 
display of information to the viewer when PIP is used in connection with the present 

mVent Hence one aspect of the present invention includes a microprocessor adapted to format 
the HTML file received over the Internet in such a manner as to accommodate the telev.sion 
program signal in one portion ofthe television screen. In this manner, the television program 
signal may be viewed simultaneously with the Internet HTML information, without 
obscuring any ofthe Internet HTML information by the television program signal. For 
example, if it is desired to place the television program signal inaPIP windoyv -in the top 
right hand comerof the television screen, the HTML file should be reformatted by the 
WebTV terminal (or other Internet display device associated with the system) to display 
information only in the remainder ofthe screen, such that it will not be obscured by the 
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station 96 and is carried by a cable provider. In alternative embodiments, the television 
signal may be sent by conventional broadcast, or by satellite. When the television signal is 
carried by cable, the user's home is typically equipped with a cable decoder 98. which 
extracts the tuned video signal, which is the television signal combined with the data unit m 
the VBL He cable decoder 98 is capable of being controlled by the microprocessor by 
infrared transmitter (not shown in the drawings). The video signal is thereafter delivered to a 
VCR 100, which also is capable of being controlled by the microprocessor by infrared 
transmitter (not shown in the drawings). Both the video signal and the data in the VBI of the 
video signal are delivered to the television 70. VBI decoder 72 for separating the data m the 
VBI from the video signal, and for delivering that data to the microprocessor. 

Data units may be transmitted in the VBI of all channels serving a particular broadcast 
region, or they may be included by program creators (producers, advertisers, etc) in the VBI 
of the videotape provided to a broadcaster. In this manner, when the program is replayed for 
broadcast by a broadcaster, the data unit containing the Internet site address and other 
information is present in the broadcast and may be received by any apparatus viewing the 



address is preferably related to the content of the program currently being telecast in the 
television signal, which contains the data unit transmitted in the VBI. Preferably, a 
descriptive title for the Internet site address that will enable the viewer to distingu.sh the 
Internet site from other Internet sites is also included in the data unit. When the data unit 
transmitted in the VBI is received at a television receiver with the program, it is stored in a 
temporary buffer portion 102 ofthe RAM 90. . Preferably, me sto^ ,. : 
temporary buffeds.one data unit, so that each new data unit overwrites and places the 
prevWsSrfed data unit. Alternatively, each successively received data unit is placed 
on the top of a stack in RAM, so that previously received data units will still be accessible to 
the microprocessor if desired by the viewer. 

The extracted data includes data representative of an on-screen graphical icon and an 
mtemet site address, as referred to above 

superimposes the graphical icon 95 on a portion of the display ed video s.gnal. Una i mdicating 
to the user that additional information concerning the television program is available through 
the Internet. The graphical icon will preferably be placed in an unobtrusive portion of the 
television signal, e.g. such that itis displayed on a comer of the television monitor as shown 

10 FI °The viewer is thereby alerted to the presence of additional information concerning the 
displayed television program. At the viewer's initiation, the microprocessor may begin the 
prod of acquiring the desired additional information over the totemet. Tne viewer inmates 
me process of data acquisition by pressing SELECT button 58 on remote controller 



Copied from 09973376 on 09/29/2005 



WO 98/17064 



00120000 (2496x3496x2 tiff) 

FCTYUS97/18664 



Yr\J foik iwn 

. . a i.^Mivelv the viewer initiates the process by 

selection process. e„ w „ « soon as it is received and is thus 

The^phicaliconQSisoverla^the^n- t0 ^ mo re information 

displayeds—eousiy^^^ 

aboutthedisptayedprogram.e.g.^^^ . 
concerninsane.ss^ 

e-n-*^*^^^^^ Anynumberoflntemetsiteaddressescan 
the RAM and to ext.ngu.sh the .con on the scr y pwptsseS . 

be stored in the directory intern^ 

— -s^KS=r 

optioiuilly th» coraspoiuluigtatontl s.« m . , s As 



Copied from 09973376 on 09/29/2005 



00130000 (2496x3496x2 tiff) 



present a microprocessor 118. an on-screen display facility 120, a VB1 decoder 122 (in 
addressable decoders), and a tuner 124. Thus, the present invention may be implemented in a 
cable decoder environment with the addition of a modem 126 for data connection to an ISP. 
and sufficient RAM for the receipt and display of the Internet "web page." As bidirectional 
transmission by cable becomes available, the telephone modem 126 can be eliminated and the 
cable system, in conjunction with suitable hardware, can be used to connect the user terminal 
to the Internet or other data provider. 

In a further embodiment, rather than receiving the desired additional information over 
the Internet, a dedicated computer system 128 could be utilized. In a system of this nature, 
the dedicated system would serve as a clearinghouse or dedicated database for the storage of 
the related information. When a broadcaster desired to provide additional information, it 
transfers the additional information and a unique identifying code to the centralized database 
utilizing conventional techniques. Additionally, the information may be transmitted to the 
centralized database on a television or cable signal. Finally, the additional information may 
be supplied to the user in the form of a CD-ROM or other large scale portable memory 
device Thereafter, when a user desired additional information, the microprocessor would 
initiate a connection to the dedicated system to receive and display the additional information 
in the manner described above. Such a dedicated system could be integrated with the Internet 
so that some information could be supplied to the user by Internet and some information 
could be supplied by the dedicated system. The dedicated system could be the user's own 
personal computer system so that the data site addresses received over the VBI correspond to 
data previously stored, by one of the above-described methods, in the user's personal 
computer, e.g., in a CD-ROM or transferred by modem. 

taanomermpodiraenxo^^ 
ajgpmi^top-articular television program^ to expand the information ; avmlable to an 

icon or designated as hypertext to represent that a related television program is scheduled for 
telecast If desired, different icons could be used to distinguish between currently telecast 
programs and programs to be telecast in the future. The icons are linked to data at the 

programs. This aspect of the invention is particularly convenient for a television afic.onado 
who is reading Television Guide-like articles on line to click on hypertext in the article to set 
upatelevision program for viewing or recording. If the Internet user 
record atelevision program, the user clicks on the icon with a mouse, e.g.. one cl.ck to watch 
and two clicks to record, and the CDTL data is transmitted by the Internet connection to the 
WebTV terminal at the user's location. The WebTV terminal couples the CDTL data to the 
microprocessor. If the CDTL data identifies a currently telecast program, the microprocessor 
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r <he VCR. depending upon whether one click or two chcks 
-^^•^r^^^dJ^c— IftheCDTLdata 
were entered, and sets the appropnate tuner » recording/play 

identiftesaMurepro^,^ 

tension, the viewed be ^ 
electronicmaU.and^ 
lntem et access —174^ 

Whenthisfuncnon,™^ <^£^„^<*»^«^« 

region, or may be prov.ded on a ^ C therefoie monitor the VBI of this 

ctffl - n :irr: rr^s:— — - 
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her apparatus wimaco^and to ^^^^ 
such asaminiseries which aus^ 

her home. ^ user may direct ^^ ^ h .^7^Lsferof ad ate u„it. 
mother f^^ZM^^^^ MMm 

a„ d records or displays the program at its tia. 0 f a Buy Link 138 which 

transfinring data » a portable device * i!^^ identical components having the 
,ot.»»Ulyaimil.ttolheaya«na»««"' F ' 0 - 1. «•»'•«« 



Copied from 09973376 on 09/29/2005 



00160000 (2496x3496x2 tiff) 



PCT/WS97/18664 

WO 98/17064 

same reference number, The transmitter incorporated into microprocessor 24 may also be 
pried in the form of a direct wire link, radio frequency transrmtter, or some other mean 
r P t d n g digital data to the portable device. The microprocessor is adapted to tra nsm, 
Z reeled Internet site address and/or the descriptive title thereof to the portable devce for 
deportable device must therefore be adapted to receive the —ton as 
well as to store the transmission in RAM or some other storage means. 

Once the Internet site address and/or descriptive title have been stored m the portable 

wL transmitting apparatus, possibly infrared, radio frequency, or dn-ect w.e I nk for 

internet and obtain the additional information over me Internet. 

The portable device may take the form of a portable computer, such as a Pilot or 
Newton or may take the form of a portable Internet terminal, which itself is operable to 
connect'to the Internet through an ISP, possibly by wireless two-way communion, such 
as a cellular telephone connection. Alternatively, the portable computer could be removed 
rm t : stem and the microprocessor 24 could be linked in direct com—on W1 th 
the user's personal computer 142, e.g., by IR emission of information and command 
sienals to PC interface 144. 

The described embodiments of the invention are only considered to be preferred and 
Utawiive of the inventive concept; the scope of the invention is not to be restneted to 
. . • — tov be revised by one 

iilkd in the a 
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1 An interactive entertainment network system comprising: 



CLAIMS: 

\n interactive entertainmemn=i»»u.»»/»v, r - ~ 

„ plurality of user interface units in individual homes, each usee interface unit 

" d adauservicepmviderintwo-wayconne.tionwith^modem 

2. ^einteractiveenter^^ 
provider is a networked computer system. 

3. Uemteractiveenter*^^ 
provider- is an Internet service provider. 

B memory for storing the at least one data unit; 

(a) for storing the at least one data unit in the memory 
.p^ntativeofthe data site address on the display device simuitaneously w,th the 
television 

*-^?ttZZZZZZ ^display*, 
guested data received from the data service provider on the disp.aydev.ee. 
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5. Thedi S playco„troHerofdaim4 > inwhichth e ex«ctingmeansi S ave rt icalbla n king 
interval (VBl) decoder. 

6 The display controller of claim 4, in which the video display orator comprises a 
pictures-picture (PIP) generator, and wherein the microcontroller controls the v.deo d.splay 
'Inlortodisplaythe television program in a PIP window simultaneously w,th the 
information representative of the data site address on the display dev,ce. 

7 Thedisplaycontrollerofclaim^inwhichthevideodisplaygeneratorcomprisesa 
PIP generator, and wherein the microcontroller controls the video display gener * ° r 
d!X the television program in aPIP window simultaneously wl th the requested data on me 
display devices. 

jr further 



8 The display controller of claim 7, in which the video display g« 
d "7ay device whereby none ofthe requested data isobscured by thePIPwmdow. 

9 The display controller of claim 4, in which the video display generator comprises a 
graphic^ne^^^ 

display on the display device. 

10 The disolav controller of claim 4, in which the video display generator comprises a 
the display device. 

11 The display controller of claim 4. in which the video display generator comprises a 
character generator which generates text representative of the data correspond to the data 
site address for display on the display device. 

n The display controller of claim 4, in which the microcontroller comprises means for 
switching betwecnatdevision mode in which the television program* displayed — 
information representative of data site address and an information mode m which he 
television program and information representative of the data s.te address are delayed 
simultaneously. 

13. The display controller of claim 4, in which the display controller is incorporated into a 
cable box. 
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14. The display control of 
video cassette recorder (VCR). 

,5. Amethodforenhancmgview^ 
retrieval comprising the steps of: 

signal containing a television program; 

(b) receiving the television signal; 

(c) extracting the at least one data unit from the televiston s.gnal; 

W Clayii information representative of the data address site simultaneous* wUh 
the television program on a display device; 

(e) storing the data address site in a memory; 
f) selecting the information representative of the data address site; 

(g) establishing a connection with a data service provider.havmg access to data 
corresponding to the selected data address site; 

(10 requesting the data corresponding to the data address Site; 

display device. ^ '.,,„,,. 

IS. T^wfrM^cWtalS.to 
"' iddress sites in the memory. 

cLprising at least two of the data address sites, and wherein step (F) comprises selectmg a 
particular data address site from the menu. 

simultaneously with the information representative ofthe data addressee. 
19. Themethodofclaiml 8> inwhichp^ 

Program is displayed simultaneously with the television program and the mformaUon 
representative of the data site address. 
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20 . ^eme^odofclaimlS.in^chthedafaco^pondingtotheda.aaddresssiteis 
data available through the Internet. 

purchasing information. 

comprises commands for controlling recording of a television program. 

23 Themcthodofclaim 1 5, in which the information representative of "ft. data address 
JLsatextualdescriptionofthedatacorrespondingtothedataaddresssUc. 

24. T*emethodofclaiml5,in which the information representative of the data address 



25 nememodofclaiml^nwhichthegraphicaliconisasymbo.identifyingthedata 
corresponding to the data address site as an Internet data page. 

26 ^ cme modofclaim24,inwhichthe g r ap hicaliconi S asy m bolidentifyingthedata 
corresponding to the data address site as purchasing informat.on. 

- The method of claim 24. in which the graphical icon is a symbol identifying the data 
^napoafc^*, Ac d»» sia: as VCX progranr^g a»c=scac 
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